Checked coverage: an indicator for oracle quality
نویسندگان
چکیده
A known problem of traditional coverage metrics is that they do not assess oracle quality—that is, whether the computation result is actually checked against expectations. In this paper, we introduce the concept of checked coverage—the dynamic slice of covered statements that actually influence an oracle. Our experiments on seven open-source projects show that checked coverage is a sure indicator for oracle quality and even more sensitive than mutation testing. Copyright © 2013 John Wiley & Sons, Ltd.
منابع مشابه
Are We There Yet? Determining the Adequacy of Formalized Requirements and Test Suites
Structural coverage metrics have traditionally categorized code as either covered or uncovered. Recent work presents a stronger notion of coverage, checked coverage, which counts only statements whose execution contributes to an outcome checked by an oracle. While this notion of coverage addresses the adequacy of the oracle, for Model-Based Development of safety critical systems, it is still no...
متن کاملReducing Oracle Cost in Search Based Test Data Generation
Search Based testing has proved effective at generating test data to cover targeted branches and has consequently received a great deal of attention from the automated software testing community. However, previous approaches to search based test data generation do not take account of oracle cost. While there may be an aspiration that systems should have models, checkable specifications and/or c...
متن کاملData Resource Profile: Countdown to 2015: Maternal, Newborn and Child Survival
The Countdown to 2015 country profiles present, in one place, comprehensive evidence to enable an assessment of a country's progress in improving reproductive, maternal, newborn and child health. Profiles are available for each of the 75 countries that together account for more than 95% of all maternal and child deaths. The two-page profiles are updated approximately every 2 years with new data...
متن کاملAutomating regression testing for evolving GUI software
With the widespread deployment of broadband connections worldwide, software development and maintenance are increasingly being done by multiple engineers, often working around-theclock to maximize code churn rates. To ensure rapid quality assurance of such software, techniques such as “nightly/daily building and smoke testing” have become widespread since they often reveal bugs early in the sof...
متن کاملAir quality as respiratory health indicator: a critical review.
As part of the European Public Health project IMCA II validity and practicability of "air pollution" as a respiratory health indicator were analyzed. The definitions of air quality as an indicator proposed by the WHO project ECOEHIS and by IMCA I were compared. The public availability of the necessary data was checked through access to web-based data-bases. Practicability and interpretation of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Softw. Test., Verif. Reliab.
دوره 23 شماره
صفحات -
تاریخ انتشار 2013